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AMTTT.TI4.AYRR DTRELAY AND A METHOD FOR DISPLATO^ 
IMAGES ON SUCH A DISPLAY _ 

Technical Field 

This invention relates generally to display devices and more 
5 particularly, to a display structure comprising multi-layered images 
and a method of extracting depth from two dimensional video data 
to display on such a device. 

Background Art 

Conventional display devices present images on a two dimensional 
10 screen. Common displays are cathode ray tubes (CRTs), liquid 
crystal displays (LCDs), Field Effect Displays (FEDs), and 
projection displays, among others. Various attempts have been 
made to incorporate the illusion of depth on two dimensional 
displays. These methods achieve the illusion of depth by presenting 
15 separate images to each eye of the viewer. 

The main methods of achieving the illusion of depth have been 
stereoscopic and auto-stereoscopic displays. 

Stereoscopic displays generally use composite images which are 
split into two images by glasses worn by the viewer. Each eye piece 
20 in the glasses will allow certain characteristic light patterns 
through to each individual eye. Popular methods of achieving this 
are through the use of polarisation, shutter glasses, defraction 
grating, multi colour lens, and dual screen head mounted displays. 

Auto-stereoscopic displays do not use glasses but instead generally 
25 use a lens configuration in which stereo images on a screen are 
aligned through lens or optical grating to focus in the general area 
of the viewers' individual eyes. 
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One main problem associated with these displays reside in the 
inability to gain convergence of stereo images to match the distance 
between the viewers' eyes. Incorrect convergence leads to 
disorientation and possible nausea when viewed for extended 

5 periods. In the case of most auto-stereoscopic displays the viewing 
area is limited to the focal length of the lens used. This limits the 
number of simultaneous viewers of a single screen. Traditional auto 
stereoscopic displays are limited to one or two simultaneous 
viewers. While, traditional stereoscopic displays require all users to 

10 wear glasses. In addition each of these methods require head 
tracking devices to be incorporated in order to achieve motion 
parallax. 

Certain designs have been made that use multiple levels of 
imagesXUS Patent 4,736,214) These designs incorporate reflected 
15 images from single or multiple sources. The reflected images of 
these designs produce "ghostly" multi layered images, which are 
generally unacceptable for normal lighting conditions. 

Images transmitted to these display devices via antenna, VCR, 
cable etc. are generally compressed during transmission. It is 
20 common for these compression algorithms to compress based on 
pixel change between consecutive frames. 

It is an object of the present invention to address the foregoing 
problems or at least to provide the pubUc with a useful choice. 

Ftirther aspects and advantages of the present invention will 
25 become apparent from the ensuing description which is given by 
way of example only. 
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Disclosure of Invention 

It is the purpose of this invention to specify a display which 
improves upon the limitations of display devices mentioned above, 
while incorporating actual depth, 

5 According to the present invention depth is created by combining 
multiple layers of selectively transparent screens. Each screen is 
capable of showing an image. Each foreground screen is also 
capable of becoming transparent. 

The preferred embodiment of this invention creates an improved 
10 display device incorporating depth, by combining multi -layers of 
selectively transparent screens to create true depth while 
incorporating common compression algorithms to extract images 
into separate channels to be displayed on each screen of the multi- 
layered display. Implementation of multiple techniques have been 
15 used to achieve this end, which solve many problems exhibited in 
the prior art. 

Reference throughout this specification will now be made to the 
present invention as utilising LCDs for each screen layer. 
However, it should be appreciated by those skilled in the art that 
20 other types of screens that can selectively show an image and 
selectively become transparent may be used in conjunction with the 
invention, not necessarily being LCDs. 

In a preferred embodiment of the present invention the screens are 
aligned parallel to each other with a pre-set distance between them. 
25 This distance depends on the level of desired depth related to the 
screen sizes. Typically this distance is ^4 the vertical height of the 
front screen although the actual distance may be changed to fit the 
desired effect. The distance between screens may also be varied in 
real time to enhance the effect. 
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Images displayed on the screen furthest from the viewer 
(backgroimd screen) will appear at some depth behind images 
displayed on the screen closest to the viewer (foreground screen). 
The transparent portions of the foreground screen will allow 
5 viewers to see images displayed on the background screen. 

This arrangement of layering multiple screens allows images to be 
presented at multiple levels giving the viewer true depth without 
use of glasses or lens. It also allows for motion parallax without 
head tracking devices. 

10 Additional layers may be added to give greater depth to the display. 

In addition a refractor may be placed between the screens to 
increase viewing angle. This refraction layer bends light such that 
viewing angle is increased to the full size of a screen placed in front 
of the refractor. The refractor may be a parallel sheet of optically 
1 5 clear material or any other type of lens including frensel lens. 

If the foreground screen device chosen requires a polarised light 
source to display an image then that polarised light source may 
emanate from a background screen. This is accomplished by placing 
a polarisation sheet in front of a non-polarised screen or using a 
20 polarised light output display such as an LCD as the background 
screen. 

Polarised light emanating from a background screen allows a 
foreground screen of LCD structure to remove its rear polariser 
while still displaying an image. This is due to the fact that the 
25 background screen provides the polarised light necessary to produce 
a viewable image on the foreground screen. 

Removing the number of polarisers in an LCD configuration has 
the advantage of reducing the number of components and 
increasing the brightness of the display. 
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In such a configuration the foreground image will no longer appear 
on the foreground screen if the polarised source is blocked. By 
placing a highly diffuse material between the polarised light source 
and the foreground screen the foregroxmd images will disappear 
5 where the polarised light is blocked. This gives the illusion that the 
foreground image displayed is passing behind the diffusion source. 
To enhance the effect the diffuser may also contain an image. 

For example, the foreground screen displays an arrow moving from 
the left to the right of the screen, Inbetween the foreground screen 
10 and the polariser is placed an image of an apple printed on a diffuse 
material. When the arrow is in a position to have its polarised light 
source blocked by the diffusion material it will appear to fall behind 
the apple imprinted on such diffusion device. 

By using a selective diffuser in place of the diffusion material one 
15 may selectively diffuse images presented on the rear screen 
allowing for infinite depth to be conveyed. 

When multiple layered LCDs are used the polarisers of said LCDs 
must align in such a way that the polarisation angle of the 
background LCD aligns with the polarisation angle of the rear of a 
20 foreground LCD. Aligning polarisers is not necessary in cases 
where high brightness is desired or if the foreground image can be 
inverted. In this case an inverted foreground image will appear non 
inverted (inverse of an inverted image = non inverted image). 

It may be necessary in certain screen combinations to include a 
25 slightly dififiise layer to eliminate moire interference patterns. This 
has the additional effect of eliminating the need to align polarisers 
and increasing angle of view. 
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Each layer of the display will have an individual video signal. 
These signals may originate from separate sources or be extracted 
from a single source conventional signal. 

In a two layer display using separate sources the background may 
5 be transmitted as a signal and the foreground transmitted as a 
second signal to their respective screen. For example, the 
background image may be of a moimtain and the foreground image 
of a car passing in front of the mountain. 

Separate sources may be filmed with multiple conventional 
10 cameras, or three dimensional cameras, or blue screen, or chroma 
key or alpha channel or any combination of industry standard 
cameras. 

Single source depth extraction may be performed using 
conventional compression algorithms used in transmission of video 
15 data. Prior Art video compression algorithms commonly utilise 
pixel change between consecutive frames in order to reduce the 
bandwidth of the data transmitted. This data on pixel change taken 
from the video compression algorithm can be used to extract depth 
based on the amount of change each pixel undergoes. 

20 Compressed signal is sent to display where video streams to each 
layer are extracted from the signal based on pixel change. 

For example, a standard video may be made of a car passing a 
moimtain. The camera is fixed such that the car passes the field of 
view while the mountain remains still in the frame. 

25 In such a video the pixels representing the passing of the car will 
change whereas the pixels representing the mountain will remain 
constant. Thus, the pixels with the most change (car) will be 
assigned to the foreground screen where the pixels with the least 
change (mountain) will be assigned to the background screen. 
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It should be understood that portions of this summary devoted to 
polarisation are not limited to LCD structures as it can be easily 
understood by those skilled in the art that other non polarised 
displays may be adapted to incorporate certain polarisation 
5 characteristics if so desired. 

Further more, it is easily understood by those skilled in the art that 
the above simimary covers the use of all screen types not only 
LCDs. The only requirement for the screen type is an ability to be 
transparent. As such it should be understood to cover, but is not 
10 limited to Projection, CRT, FED and LCD screens. 

Brief Description of Drawings 

Further aspects of the present invention will become apparent from 
the following description which is given by way of example only and 
with reference to the accompanying drawings in which: 

15 Figure 1 is a diagrammatic view of a basic multi-layered display 
in accordance with one embodiment of the present 
invention. 

Fi gure 2 illustrates a multi-layered screen with a refractor in 
accordance with one embodiment of the present 
20 invention. 

Figure 3 illustrates the moire interference pattern in multi- 
layered displays in accordance with one embodiment of 
the present invention. 

Figure 4 illustrates a diffuser and its effect on the moire 
25 interference pattern in accordance with one 

embodiment of the present invention. 
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Figure 5 illustrates a multi-layer display with added depth in 
accordance with one embodiment of the present 
invention. 

Figure 6 illustrates a multi-layered display with added clarity 
5 in accordance with one embodiment of the present 

invention. 

Figure 7 illustrates a tri-level display in accordance with one 
embodiment of the present invention. 

Figure 8 illustrates a method of displaying images to each 
10 screen level in accordance with one embodiment of the 

present invention. 

Best Modes for Carrying out the Invention 

In the following, detailed descriptions of the preferred embodiments 
of this invention are revealed. Although a complete specification is 
15 revealed it should be tmderstood by those skilled in the art that 
each aspect of the preferred embodiments may be used 
independently or in conjunction with other illustrations of this 
invention while still conforming to the general specification of a 
multi-layered display device. 

20 The preferred embodiments of this invention create an improved 
display device incotporating depth, by combining multi-layers of 
selectively transparent screens. 

A simplified multiple layered image display is shown in Figure 1, A 
background screen 1 is placed at some distance 2 behind a 
25 foregroxand screen 3. In some display types such as LCDs back 
lighting 4 may be required. Each screen is capable of showing 
images 5, 6. Images displayed on the foreground screen 6 appear to 
be closer than images shown on the background screen 5. 
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The addition of a refractor placed between screens is represented in 
Figure 2. Light 7 transmitted to the viewer 8 is bent to 9 at 
refraction angle 10 of the material such that the edge of the rear 
screen is not seen from any angle of view. Without the refraction of 
5 light the edge of the rear screen would be clearly seen 11 from any 
angle less than 90 degrees. 

For minimum distortion a sheet of parallel optically clear material 
such as glass or acrylic may by used as a refractor 12, Such a 
refractor would restrict the front screen 3 to being of a smaller size 
10 than the background screen 1. In a preferred embodiment of the 
present invention the foregrotmd screen size would have its edge no 
less than 135 degrees from the edge of the rear screen. 

In another preferred embodiment the refractor may be a lens 
including but not limited to frensel. In this embodiment the screens 
15 may be of similar size. 

The addition of a slightly diffuse layer 13 placed between screens is 
shown in Figure 4. Without this layer, interference 14 is created by 
the combination of slightly different pixel patterns of subsequent 
screen layers. Placing the diffusion layer 13 between screens 
20 slightly diffuses the pixel pattern in each screen eliminating 
interference 15. 

Alternately interference can be eliminated by using a stripe pixel 
pattern on one screen and a 45 degree diagonal pixel pattern on 
another. 

25 For further clarification a complete assemble is shown in Figure 5. 
This combination produces a display with a finite true depth 
defined by the distance between screens 3, 6. It also creates an 
infinite depth illusion with the addition of a selective dififuser. 
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A polariser sheet 17 is placed at the front of the rear screen 1. This 
creates a polarised light sotirce. Alternately the rear screen could 
also be an LCD with a polarised output. In front of the polariser is 
placed a selective difftiser 18. In front of the diffuser is a refractor 
5 8. In front of the refractor is placed a LCD without a rear polariser 
16. 

When the selective diffuser is set to transparent, the rear screen 
outputs polarised light to allow an image on the foreground screen 
to be visible. 

10 When the selective diffuser is set to dififiise, the rear screen 
polarised light output is converted to diffuse light, which renders 
the foreground image invisible. 

With certain screen technologies such as LCD it is desirable to have 
the ability to render the foreground screen opaque. This preferred 

15 embodiment is represented in Figure 6. This combination produces 
a display in which the foreground screen is rendered opaque. In this 
configuration the rear screen 1 is followed by a refractor 12 which is 
followed by a selective diffuser 18 which in turn is followed by the 
foreground screen 3. To make images on the foreground screen 

20 opaque the selective diffuser is selected to diffuse the area behind 
the area selected to be opaque. 

In yet another embodiment of the present invention Figure 6 
represents a Tri-layer display incorporating most of the previously 
mentioned techniques. This display provides three finite depth 
25 planes with the foremost screen 19 being selectively opaque due to 
the selective diffuser 18 placed behind it. The middle LCD screen 

16 would have infinite depth due to its lack of rear polariser and 
the ability of the selective diffuser 18 in front of the rear polariser 

17 to diffuse polarised light required for its operation. 
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The general method of transmitting images to the screens is 
represented in Figure 8, Image 19 is transmitted to the 
backgroxmd screen 1. Image 20 is transmitted to the foreground 
screen 3, 

5 Alternatively the separate video signal can be extracted from a 
single image using data produced by most common video 
compression algorithms. For example a video signal is transmitted 
of a car passing in front of a moimtain 21, creates a sequence of 
frames 22. This sequence is fed through a video compression 

10 algorithm 23 which converts the image to a sequence of numbers 
representing pixel properties such as pixel colour, pixel location and 
amount of pixel motion between consecutive frames. 

In this example, pixels with a change value above a threshold of X 
via path 24 to the foreground screen while pixels with a change 
15 value below X are sent via path 25 to the backgroimd screen. In the 
present implementation (Figure 8) pixels representing the car have 
a high value for pixel change and will be directed to the foreground 
screen and the mountain having a pixel change value of less than X 
will be directed to the background screen. 

20 It can be easily understood by those skilled in the art that the 
threshold value and tolerance of this value may be adjusted to gain 
a variety of outputs. In addition multiple threshold values may be 
defined in multi-layered displays with over two layers. 

Thus, it can be seen from the foregoing detailed description and 
25 attached drawings that the present invention includes methods of 
displajdng depth in a display allowing for motion parallax, true 
convergence, and wide angle of view without the viewing 
restrictions of prior art displays. 
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It can also be appreciated that taken individually each component 
enhances the depth of the display but may also operate 
independently and in combination to enhance traditional displays. 
It is obvious to someone skilled in the art that the following claims 
5 may be combined in various manners* 

Aspects of the present invention have been described by way of 
example only and it should be appreciated that modifications and 
additions may be made thereto without departing from the scope 
thereof. 
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1. A display using multi-layered images each layer formed by a display device or 
combination of display devices in which the foreground screen(s) is(are) 
selectively transparent and with a slightly diffuse layer placed on the front of a 
background image. 

2. A display as claimed in Claim 1 which has a refractor between layers. 

3. The display as in Claim 2 with said refractor being of optically clear material 
placed between images such that the image in the foreground is no less that 45 
degrees from the edge of the screen to its rear. 

4. The display as in Claim 2 with said refractor being a fresnel lens. 

5. The display as in either Claim 2 or Claim 3 with said refractor diffused on the 
side facing the rear screen. 

6. A display as claimed in Claim 1 wherein the space between images is able to be 
adjusted in real time. 

7. A display using multi-layered images each layer formed by a display device or 
combination of display devices in which the foreground screen(s) is(are) 
selectively transparent with layered images being aligned such that a 45 degree 
angle can be measured in relation to their respective pixel alignment 
configurations. 

8. A display using multi-layered images each layer formed by a combination of 
transmissive polarized display devices in which the foreground screen(s) is 
(are) selectively transparent and one or more internally facing polariser is 
removed. 

9. A display as claimed in Claim 8 wherein one or more object is introduced to 
block polarised light to a foreground image, 

AMENDED SHEE 
IPEA/AU 
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10. The display as in any one of Claims 1 to 9 with a selective diffuser used to 
diffuse light vv^hich renders a foreground image opaque. 

1 1. The display as in any one of Claims 8 to 10 with selective diffusion layer which 
renders a foreground image requiring polarised light transparent by blocking 
polarised light. 

12. A display as claimed in any one of Claims 1 to 1 1 incorporates digital or analog 
depth extracting techniques from 2d images, 

13. A display as claimed in any one of Claims 1 to 12 which incorporates digital or 
analog depth extracting techniques from 2d images were amount of change to 
pixel from previous and next frame indicate amount of depth to assign. 

14. A display as claimed in either Claim 12 or Claim 13 wh^ tks ammmt of focus 
in a subset of pixels indicates the amount of depth to assign. 

15. The display as claimed in any one of Claims 12 to 14 where the amount of 
sharpness in a subset of pixels indicates the amount of depth to assign. 

16. A display substantially as herein described with reference to and as illustrated 
by the accompanying drawings. 
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Febmary 20, 1998 


E YES Q NO 


Nevt^ Zealand 


329834 


Fefamarv24. 1998 


G) YES □ NO 


) hereby claim the benefit under 36 U S.C. § 119(e) c 
beiow: 


»f any United states provisional application(s) listed 


1 Application Number 


Dateofpfling 











I hereby claim the benefit under 3B U.S.C. § 120 of any United States applioaBon(e) or § 365(0) of any 
PCT international Bpplicaeion(e) designating the United States, listed bdowand, Insofar ad the subject 
matter of each of the claims of this application is not disclosed in the prior United States or PCT 
international application(&) in the manner provided by the finst paragraph df 35 U.S.C. § 112, i 
acknowledge the duty la disclose inftomiatlon which isi material to patentability as defined in 37 CFR • 
§ 1 .56 which became available between the filing date of the prior appljcation(e) and «ie national or PCT^ 
International filing dat$ of this appfication: 



Application Number 


Date of Filing 


Status (Patented. Pending. 
Abandoned) 
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( hereby appoint tho fblfowing attorney and^or agent(s) to prosecute this application and transact all 
business In the Patent and Trademark Office connected therewith, FINNEGAK, HENDERSON^ 
FARABOW, GARRETT A DUNNER, LL-P., Reg, No. ZSUMfl^Douglas B. Henderson, Reg. No. 20,291; 
Ford F, Farabow, Jr., Reg. No. 20^630: Arthur s. Garrett, Reg. No. 20,338; Donald R. Dunner, R^. 
Mo. 1?^!73LBrIan G. Brunsvold» Reg/No. 22,S93; Tipton D. JenningsTVrReg. No. 20,645; Jeny D. 
Vofght. Reg, No. ^pOgO^aurqnce R. HeffSfTRej No. ZQSZU Kenneth Payne, R^rNa 23.098; 
Herbert Mintz, RigT NQ^ 28,691 ; C. Lairy O'Rourke, Reg. No. 26,014; Albert J. Santorelli, Reg. 
^No. 22.610 ; Michael C Elmer, Reg. No, 25.S5I; Richard H. Smfth, Reg. No. 20,609; Stephen L. Peterson, 
/JL Reg. No. 26.326; John M. Romary. Rag. No. 26J31;_Bruce C. Zofter, Reg. Nor2ISi8EU3ennia P 
(S^ O'Reilley. Reg. No^27^2; Allen M. Sokal, Reg. Na 26.M§LRobert D. Bajefeky, Rag. No. 26.387; 

Richard L Stroup, R^TNc^ZWa; David W. Hill, Reg. No. 28,220Jhomas L Irving. Reg. 135728^; 
Chartes E. Lipsey, Reg. No. 287^5; Thomas W. VWnland, ReaTT^o, 27.605: Basil J, Lewris. ResT" 
No. ^,818; Martin 1. Fuchs, RegTFro. 28,608; E. Robert Yoches. RegTNo r3ai20; B arry W. Graham, 
RegrN5: ^924; S usan Habennen GnffenTReg. No, 30,907; R iohard B. FSSieTReg. Na 30.415; 
Thomas HTJenkins, Reg. No. 30,B57; Robert E. Converse. Jr^ Reg. Hi>^2L^; Ctair X. MiMenrar., Reg, 
No. gOMEt-Christopher P. Fol^p Reg. No..31J[64;^ John C. Paul, Reg. NoZ^^lia; David M. KeBy, R^g. 
No: 30953; Kennetfi J. M^ers, Reg. No. Ji5,146; Carol P Efnaudl, Reg. No. 3 2.22Q: Walter Y. Boyd. Jr.. 
Reg. No. 31,736: Steven M- Anzalone, Reg. No. 32.095: 4 ean B. Foidfe, Reg. No. 3 2.&S4; Barbara C. 
McCurdy, Reg, No. 32.120; James K. Hammond, Reg. No. $ifie4\ Richaid V. Burgi^ian, Reg. 
No. 31 J44; J. Michael JaKes, Reg. No. 32,824; DirkP. ThomasTR^. No. 32,600; Thomas W, Banks. 
RegrNor^719; Christopher P. isgao.T^eg. No. 32.616; Bryan C. Diner, R^gTRg 32.409: M. Paul 
Barker, R^rNgr32.01 3: An drew Chanho Sonu, Reg. No. 33,467; David S, Forman. Reg. No. SdtjSS^ 
Vincent P. Kovallck. 'Reg. N6, 32.867; J gnnes W. EdmondaSnTRegrNo. 33,871; Michael R. McGurk. Reg. 
No. 3 2,045: J oann M. Neth, Rig. No. 3B.363; Geraon S. Panltch. Reg. N6r3 g7gi; Cheri M. Taylor. Reg. 
No. 33^219;: Charies E. Van Hom. RegrNor4ej2e6; and Unda A. WSadler, RegrRor33,,218;Jeffray A, 
BerfcowiSTReg, No. 36.743; jjichael R. Kelly, Reg. No. 33.921; J ames B. Monroe. Reg. No. Doris 
Johnson Nines. Reg.'TIar^;^; Allen R. Jenaen. Reg. No. 28,224;. LQri Ann Johnson, Reg. No. 34,498;- 

and David A. Manspeizer. RegTNo. 37,^640 and . Please 

address all correspondenoe te FJ NNEGXWrllENDERaON. FARA BQWUSARRFTr^^ 
1300 I Street N.W., Washington, D,C. 20005, Telephone Nap^r4^=:^0ISr~ 

1 hereby declare that all statements made herein of my own Knowledge are true and that all statements 
made on Information and belief are believed to be tme; and further that these statements were made with 
the knowledge that willful false statements and the like so made are punishable by fine or Imprisonnnent, 
or both, under section 1001 of Title 13 of the Unrtad States Code, and that such wiUful false statements 
may Jeopardize the validity of the appncatbn or any patent issuing thereon. 



Full Name of first Inventor 

PitaWITEHlRA C: 


fiwefttor's Signa^UFe 

1 / \/ A tC^^ ^ 


Dale ^ ^ 


Residervce 

Hamilton, New Zealand ZX^ 


Country of atlzenshlp 
New Zealand 


Post Offlce Address 

Davlne Road, R03 
Hamilton. New Zealand 
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Full Nantft of Second Invsntor 
Gabnel Damon ENGEL 


Inventor's Sjgi^ 

^ 'T^ 








Reskfence 

Hamilton, New Zealand 








Country of ClHzenehfp 


Post Ofnce Address 

Rat 4, 19 Kammond Street 
Hamilton, New Zealand 
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